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Platforms and Algorithms 
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Platforms and Algorithms 
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Overview of Effort 


Year 1 Build hardware, begin writing software and 
arrange flights 

Year 2 Run simulated science scenarios (e.g. 
instrument calibrations) 

Year 2 Begin Flight tests 

Year 2 Investigate software benchmarks 

Year 3 More flight tests and benchmarks based on 
results of year 2 

Year 3 Recommendations for future missions 


Key Methods to Accelerate Onboard 
Computing for a Space Environment 


Intelligent onboard data reduction 

Parallel processing, multicore processors 

Use of FPGA as co-processor to accelerate portion 
of algorithms 


Example 1 of Intelligent Onboard 
Data Reduction: Autonomous 
Modular Sensor Onboard 

Processing 


Existing Autonomous Modular Sensor (AMS) 
Pre-processing/Product Relationships 
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Burn Area Emergency Rehabilitation Imagery 



BAER Bands: 
10-7-9 

Linear Stretched 2% 
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CCRS (Hot Pixels Algorithm) 


WCPS Generated Provided Original 
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Hot Pixels as Topojson on Github 


geojson.io: Edit CeoJSON 


LlL 


geojson.io/#id=gist;cappelaere/770dc8388c021ca6091b&map= 14/33. 35 53/-1 16. 5015 C geojson.io 
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B & + © r+ ® Table </>JSON ?Help 



new column 


Vectorized Hot Pixs to 
Topojson format ( 50% 
simplification) 

File Size: 6KB (2KB 
■tgz) 


Topojson converted to 
C++ from javascript 


Potrace integrated into 
WCPS 


Displayed on MapBox 
TopoMap 


Can be shared on 


Facebook/Twitter. . . 
All Open Source 

http://qeoison.io/#id-qist:cappelaere/770dc8388c021ca6091b&map=14/33.3553/-T16.5015 




Metrics 


• Original AMS files size 3.1 Mbytes 

• Potrace - converts to raster to vector with the output being GeoJSON 

- Geographic Javascript Object Notation (GeoJSON) file size is 31 kbytes 

• Topographic Javascript Object Notation (TopoJSON) converts GeoJSON to 
TopoJSON format 

- file size is 6 kbytes (choose 50% simplification of vectors) 

- User selectable to about 90% 

• Compress TopoJSON using ZIP 

- Compressed size is 2 kbyte 

• Compression of 1000:1 

• Download 2 kbyte GitHub then can visualize on built in map visualized (Mapbox) 

- OpenStreetMap compatible 

- Viewable in browser 

- Shareable on Facebook and other social media 

- Github is used for versioning on maps and thus will store user annotation to 
map 
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Example 2 for Intelligent Onboard 
Data Reduction: Running 
Coregistration with Chips 
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Global Land Survey Maps 


A collection of Landsat-type satellite images 
from USGS 

• Near complete global coverage 

• Orthorectified 

• Each image has cloud cover of less than 10% 

• Four versions: 1970, 1990, 2000, and 2005 

Ground truth for the registration programs was 
drawn from the GLS 2000 and can be updated 
when the GLS 2010 is completed 

http://landsat.usqs.gov/science GLS.php 


Chip Registration 



Area in EOI scene where chip was extracted 


Currently “chip database" created (in a brute-force fashion) by extracting 
successive 256x256 sub-images of all GLS scenes and storing them 

according to path and row 
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Automatic Registration of EOl Scenes 
Using Global Land Survey (GLS) Database 





1. Find Chips that correspond 
to the Incoming Scene 

2. For Each Chip, Extract 
Window from input scene 
using UTM coordinates 

3. Eliminate Windows with 
insufficient information 

4. Smooth and Normalize gray 
values of both Chip and 
Window using a Median Filter 

5. Register each (Chip, Window) 
Pair using a wavelet-based 
automatic registration: get a 
local rigid transformation for 
each pair 

6. Eliminate Outliers 

7. Compute Global Rigid 
Transformation as the 
median transformation of all 
local ones 

8. Compute Correct UTM of 4 
Scene Corners of input 
scene 

9. If desired, Resample the 

input scene according to the 
global transformation / 
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Scene 1 Before Automatic Registration 
Superimposed onto Goggle Earth 



Scene 1 After Automatic Registration 


Superimposed onto Goggle Earth 
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Scene 2 Before Automatic Registration 
Superimposed onto Goggle Earth 
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Scene 2 After Automatic Registration 
Superimposed onto Goggle Earth 
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Conclusions and Future Work 


. Results visually acceptable 
. Computations very fast and real-time 

. RMS still too high (Translation errors between 0.4 and 2.5 pixels) because: 

1 . Chips and windows need to be pre-selected based on the information 
content (e.g., using an entropy measure) 

=^> Registration would be more accurate because transformation would 
only be computed on pairs that have a significant amount of features 

=^> Registration would be faster because less local registrations 

=> Chip database would be smaller to be stored onboard 

2. Global transformation should be computed by taking the list of original 
corners coordinates of each window and their corresponding corrected 
coordinates, and treat them as a list of ground control points and their 
corresponding points => after outlier elimination, global transformation can 
be computed using a rigid, an affine or a polynomial transformation. 

3. Masks for clouds and water should be included, so registration would not 
use cloud or water features that are often unreliable 


Onboard, computations can be performed on SpaceCube or hybrid processor 
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Representative IPM Data Processing 

Chain & Metrics 

Building to Helicopter Experiment 


Hyperspectral Image Processing 
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864 MHz TILEPro64 
(1 core) 

121.95 

2477.74 

183.42 

72.39 

864 MHz TILEPro64 
(49 cores) 

23.83 

1744.13 

4.59 

21.63 

1.0 GHz 
TILE-Gx36 
(1 core) 

57.22 

897.71 

28.51 

19.93 

1.0GHz 
TILE-Gx36 
(36 cores) 

9.21 

588.71 

1.41 

8.72 

2.2GHz Intel Core 17 

2.09 

58.29 

0.169 

2.26 

Virtex 5 FPGA 
Imaqe data: 

TBD 

TBD 

TBD 

TBD 


GLiHT 1 004 x 1 028 x 402 (829,81 8,048 bytes) 
Hyperion (EOI HI 7407320011511 1 1 K3) 

256 x 6702 x 242 (830,404,608 bytes) 

Chai640 696 x 21 03 x 283 (828,447,408 bytes) 


Notes: Unit is in seconds 
TILEPro64 - No floating point support 
TILEGx36 - Partial floating point support 
* Indicates time includes file I/O 


23 






FLAASH Parallelization Effort 


Original Parallel 
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Time spent in FLAASH components 


0% 



■ Surf ref lectance 

■ Cube smoothing 

■ Cube reduction 

■ Cube load & distrib 

■ Cube gather & write 

■ Aerosol Retrieval 

■ Water col retrieval 
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■ Spectral Resampling 
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■ Modtran Tables 
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Conclusion 


. Examining a variety of methods to speed up onboard 
processing chain to meet needs of low latency users 

. Dovetailing efforts and metrics with High Performance Space 
Computing (HPSC) effort sponsored by NASA Office Chief 
Technologist 

. IPM data processing effort applied to multiple future mission 
needs 
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